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General  factors  are  found  in  the  measurement  of  many  human  traits.  Al¬ 
though  these  factors  have  most  frequently  been  found  in  measures  of  cogni¬ 
tive  ability,  they  are  not  limited  to  cognitive  ability.  They  have  been  observed 
in  such  diverse  content  domains  as  assessment  center  ratings,  emotional 
intelligence,  personality,  psychomotor  performance,  beliefs  and  attitudes, 
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occupation  and  work,  and  leadership.  In  addition  to  general  factors,  specific 
factors  (s)  may  be  present.  They  are  indicators  of  reliable  variance  that  is  not 
shared  with  other  tests  or  measures.  If  the  nongeneral  variance  is  shared  with 
another  test  or  measure,  it  is  called  a  group  factor  (Gorsuch,  1983;  Spearman, 
1927). 

For  about  a  century,  the  phenomenon  of  general  factors  has  been  ob¬ 
served  and  described  with  reference  to  “positive  manifold.”  Spearman  (1904) 
observed  that  when  he  gave  tests  of  several  different  kinds  of  cognitive  ability, 
the  correlations  among  the  scores  were  positive.  He  called  this  effect  “posi¬ 
tive  manifold.”  The  definition  of  positive  manifold  comes  from  mathemat¬ 
ics,  particularly  topology,  and  Euclidean  space.  The  general  factor  (g)  leads 
to  positive  manifold  among  cognitive  test  scores.  Positive  manifold  among 
cognitive  tests  implies  that  scores  from  a  mathematics  test,  for  example,  will 
correlate  positively  with  those  from  tests  assessing  other  cognitive  abilities 
such  as  reading  comprehension,  spatial  reasoning,  or  vocabulary.  As  a  result, 
it  does  not  matter  which  particular  tests  are  used  to  assess  general  cognitive 
ability  ( g )  because  they  will  be  highly  correlated  despite  differences  in  con¬ 
tent.  Spearman  (1923)  termed  this  the  “indifference  of  the  indicator.”  This 
has  implications  for  the  interpretation  of  scores  both  operationally  and  as 
constructs. 

The  measurement  of  g  has  been  well  established,  as  well  as  the  greater 
predictiveness  of  g  for  educational,  training,  and  work  outcomes  compared 
with  the  predictiveness  of  specific  abilities  (s);  see,  for  example,  Jensen 
(1998).  Ree,  Teachout,  and  Carretta  (2013)  recently  summarized  the  em¬ 
pirical  evidence  surrounding  the  ongoing  debate  of  the  measurement  of  g 
and  s  and  their  prediction  of  educational,  training,  and  work  outcomes.  Ree 
et  al.  (2013)  concluded  that  (a)  g  is  pervasive — it  can  be  measured  consis¬ 
tently,  accurately,  and  routinely  across  a  wide  range  of  tests,  situations,  and 
methods,  whereas  s  cannot;  (b)  the  amount  of  g  measured  in  test  batteries 
is  frequently  50%  or  more  of  the  reliable  variance,  whereas  the  amount  of 
s  is  usually  much  less  than  10%,  and  when  considered,  the  relative  magni¬ 
tude  of  g  is  often  5  times  greater  than  s;  and  (c)  g  is  the  predominant  source 
of  predictiveness  in  cognitive  ability  tests  (e.g.,  Jensen,  1998),  with  s  often 
adding  little  to  no  prediction  of  educational,  training,  and  job  performance 
outcomes  (e.g.,  Brown,  Le,  &  Schmidt,  2006;  Ree  &  Earles,  1991a,  1992;  Ree, 
Earles,  &  Teachout,  1994). 

Purpose 

The  purpose  of  this  article  is  to  expand  on  previous  research  by  documenting 
the  prevalence  of  general  factors  beyond  that  of  cognitive  ability,  across  a  va¬ 
riety  of  human  abilities  and  psychological  constructs,  and  to  explore  reasons 
why  this  may  be  so.  The  term  dominant  general  factor  (DGF)  is  introduced 
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to  represent  the  magnitude  of  general  factors  within  numerous  content  do¬ 
mains.  Usually  the  developers  of  measures  seek  to  assess  several  unique  or 
independent  characteristics  but  instead  create  DGFs.  The  finding  of  general 
factors  extends  to  almost  all  areas  of  measurement. 

DGFs  are  not  limited  to  ability  testing  but  are  pervasive  throughout  the 
measurement  of  human  characteristics.  We  address  fundamental  questions 
that  emerge  about  the  explanations  for  DGFs  and  about  why  they  appear  to 
be  so  prevalent.  Finally  we  identify  future  research  needs  and  implications 
for  practice. 

Constructs 

Constructs  should  be  measureable,  interpretable  from  empirical  obser¬ 
vation,  and  distinguishable  from  other  constructs.  Construct  validity 
(Cronbach  &  Meehl,  1955)  is  concerned  with  the  extent  to  which  an  instru¬ 
ment  measures  what  it  purports  to  measure.  We  often  identify  specific  fac¬ 
tors  as  the  constructs  in  which  we  are  interested,  but  this  ignores  the  arguably 
more  important  role  of  DGFs. 

Factor  analysis  is  frequently  used  to  detect  and  interpret  factors  in  mea¬ 
sured  human  characteristics.  Factors  are  often  interpreted  as  measuring  the 
construct.  Often  the  naming  of  these  factors  is  subjective  and  is  dependent 
on  the  apparent  content.  This  naming  on  the  basis  of  apparent  content  is 
frequently  supported  by  consensus  rather  than  by  empirical  evidence.  For 
example,  retranslation  procedures  (Smith  &  Kendall,  1963)  are  often  used, 
whereby  subject  matter  experts  match  items  or  questions  to  constructs  on 
the  basis  of  their  content.  Even  when  empirical  evidence  is  presented,  inter¬ 
pretation  frequently  depends  on  judgments  or  consensus. 

In  the  naming  of  factors,  emphasis  is  given  to  specific  content.  As  has 
been  pointed  out  before  (Ree  &  Carretta,  1998),  the  verbal  factor  in  cognitive 
test  batteries  is  a  combination  of  a  specific  verbal  and  a  DGF,  in  this  case  g. 
In  all  cases  studied,  the  proportion  of  variance  accounted  for  by  the  specific 
factors  is  very  small,  and  the  proportion  accounted  for  by  the  general  factor 
is  very  large.  This  may  lead  to  misinterpretation  of  factors  and  their  relation 
to  constructs.  The  role  of  specific  factors  may  be  overemphasized,  and  the 
role  of  general  factors  may  be  under  emphasized. 

What  Is  a  Dominant  General  Factor? 

Once  we  have  defined  the  domain  of  interest,  it  is  important  to  determine  the 
extent  to  which  a  DGF  accounts  for  the  variances  in  and  relationships  among 
the  various  specific  factors  or  constructs  subsumed  within  the  domain.  Two 
criteria  must  be  met  to  define  a  DGF.  First,  a  DGF  must  come  from  the  largest 
source  of  reliable  variance.  Second,  every  variable  measuring  the  construct 
must  be  influenced  by  the  DGF.  A  DGF  accounts  for  more  variance  than  does 
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any  other  factor  and  influences  each  observed  variable.  A  DGF  is  different 
from  a  group  factor  (Carroll,  1993;  Thurstone,  1938)  because  it  influences 
all  variables,  whereas  a  group  factor  does  not  influence  all  variables. 

It  is  important  to  note  that  a  DGF  does  not  mean  that  only  a  single  factor 
is  present.  A  DGF  does  not  imply  a  single-factor  solution,  nor  does  it  imply 
that  the  instrument  measures  only  one  factor.  In  a  factor  analysis,  the  DGF 
might  be  accompanied  by  several  other  factors.  These  specific  factors  usually 
account  for  small  proportions  of  the  variance.  The  presence  of  a  DGF  means 
that  the  general  factor  is  the  dominant  source  of  variance. 

Artifacts  in  a  study  that  reduce  variance  such  as  unreliability  and  range 
restriction  can  have  the  effect  of  reducing  the  apparent  magnitude  of  a  DGF. 
It  is  likely  that  many  of  the  estimates  of  DGFs  to  follow  are  downwardly  bi¬ 
ased  because  of  unreliability  and  range  restriction  that  reduces  reliable  vari¬ 
ance. 

Evidence  Supporting  the  Prevalence  of  DGFs  in  Human  Characteristics 

Taxonomy  of  human  performance.  As  a  point  of  departure,  we  used 
Fleishmans  taxonomy  of  human  performance  (Fleishman,  Quaintence,  & 
Broedling,  1994).  Fleishman  (Fleishman  et  al.,  1994)  proposed  that  this  tax¬ 
onomy  be  used  in  lieu  of  developing  unique  ability  labels  in  order  to  im¬ 
prove  interpretation  of  results  and  communication  among  researchers  and 
practitioners.  Taxonomies  have  driven  research  and  practice  for  decades  and 
have  contributed  to  the  content  fallacy  (Murphy,  2009a).  It  is  interesting  to 
note  that  Fleishmans  taxonomy  did  not  include  any  general  factors.  Further, 
when  used  as  a  basis  for  job  or  task  analysis,  these  taxonomies  do  not  include 
general  factors,  and  general  factors  are  therefore  not  found  in  the  results  of 
the  job  or  task  analysis.  In  addition,  we  consider  personality,  leadership,  and 
other  domains  not  included  in  Fleishman  et  al.  (1994). 

Content  and  labels.  It  is  important  that  the  content  and  labels  used  also 
represent  the  underlying  meaning  once  the  data  have  been  analyzed.  If  the 
analytic  results  support  the  label  and  content,  then  the  construct  validity  of 
the  measures  is  supported.  If  the  analytic  results  do  not  support  the  label  and 
content,  then  the  construct  validity  of  the  measures  is  not  supported  and  the 
researcher(s)  should  reexamine  the  underlying  theory  and  substance  of  the 
measures. 

Clearly,  the  labels  used  to  represent  content  and  content  validity  are  not 
necessarily  a  reliable  indicator  of  what  is  being  measured  (Murphy,  2009a, 
2009b),  nor  are  the  labeled  constructs  valid  indicators  of  the  source  of  pre¬ 
diction  of  performance  (Murphy,  Deckart,  Kinney,  &  Kung,  2013).  When  de¬ 
veloping  a  new  construct,  few  researchers  look  for  a  general  factor  (Drasgow, 
Nye,  Carretta,  Ree,  2010;  Kyllonen,  1993;  Stauffer,  Ree,  &Carretta,  1996).  Ev¬ 
idence  suggests  they  should.  The  labeling  of  factors  should  match  what  the 
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data  say.  The  labeling  should  be  consistent  with  the  magnitude  of  the  sources 
of  variance  contributing  to  the  factor. 

Estimating  DGF  Percentages 

DGFs  can  be  identified  via  an  eigenvalue  analysis  of  the  correlation  or  co- 
variance  matrix  by  comparing  “variance  accounted  for”  and  confirming  that 
the  factor  influences  all  of  the  variables.  For  example,  if  we  were  considering 
10  variables  and  the  common  factor  accounted  for  more  variance  than  did 
any  other  factor,  a  plurality  of  the  variance,  this  factor  satisfies  the  first  crite¬ 
rion  to  be  considered  dominant.  If  the  common  factor  also  influenced  all  of 
the  variables,  then  it  satisfies  the  second  criterion  to  be  considered  general. 
(See  Jackson,  2003,  Table  17.4,  p.  397).  Further,  Jackson  (2003)  went  on  to 
demonstrate  that  the  extraction  of  unrotated  principal  components  is  the 
optimal  method  for  explaining  variance. 

The  use  of  principal  components  posits  no  model  but  is  an  orthogo¬ 
nal  decomposition  that  will  reproduce  the  correlation  and  covariance  ma¬ 
trix  perfectly.  There  can  be  no  issue  of  model  accuracy.  Several  methods  of 
estimating  a  DGF  converge  on  the  same  values  (Ree  &  Earles,  1991b;  Reeve 
&  Blacksmith,  2009). 

As  the  average  correlation  among  the  scores  increases,  the  magnitude  of 
the  general  factor  increases.  It  is  primarily  through  the  off-diagonal  covari¬ 
ances  that  the  DGF  emerges.  In  order  to  create  a  general  factor,  the  sum  of 
the  covariances  must  be  large. 

Examples  of  Constructs  With  a  DGF 

DGFs  are  found  in  many  constructs.  Although  the  labeling  of  constructs  may 
improve  communication,  it  reinforces  the  idea  that  the  constructs  are  inde¬ 
pendent.  Three  detailed  examples  with  DGFs  are  psychomotor  ability,  job 
performance,  and  personality. 

Psychomotor  Ability 

Over  decades,  Fleishman  and  his  colleagues  (Fleishman,  1964,  1972,  1975; 
Fleishman  et  al.,  1994)  developed  a  detailed  taxonomy  of  human  abilities  that 
could  be  used  in  research  and  practice  involving  human  characteristics.  The 
intent  was  to  provide  standardized  definitions  and  labels  for  these  abilities,  to 
facilitate  communication  and  interpretation  of  results.  For  example,  Fleish¬ 
man  and  his  colleagues  identified  several  psychomotor  abilities  in  terms  of 
control,  precision  of  movement,  and  speed.  These  are  arm-hand  steadiness, 
control  precision,  finger  dexterity,  manual  dexterity,  multilimb  coordination, 
rate  control,  reaction  time,  response  orientation,  speed  of  limb  movement, 
and  wrist-finger  speed. 

Researchers  have  examined  the  construct  validity  of  several  psychomo¬ 
tor  constructs  from  Fleishmans  taxonomy.  Despite  a  desire  to  measure 
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specific  abilities,  careful  specification,  and  expert  agreement,  in  each  case  a 
DGF  for  psychomotor  ability  was  found  that  accounted  for  between  39%  and 
42%  of  the  variance  (Carretta  &  Ree,  1997;  Ree  &  Carretta,  1994a;  Wheeler 
&  Ree,  1997).  In  no  instance  did  the  specific  abilities  account  for  as  much 
variance  as  the  DGF,  and  most  of  the  remaining  variance  was  accounted  for 
by  unreliability 

Job  Performance 

Campbell,  McHenry,  and  Wise  (1990)  proposed  a  multidimensional  the¬ 
ory  of  job  performance.  Eight  dimensions  that  were  considered  to  be  broad 
and  generalizable  across  jobs  were  proposed.  These  are  job-specific  task 
proficiency,  non-job-specific  task  proficiency,  written  and  oral  communica¬ 
tion  task  proficiency,  effort  demonstration,  personal  discipline  maintenance, 
peer  and  team  performance  facilitation,  supervision/leadership,  and  man¬ 
agement/administration.  Campbell,  McCloy,  Oppler,  and  Sager  (1993)  de¬ 
scribed  these  as  the  highest  order  factors  that  could  be  useful  and  did  not 
include  a  general  factor  of  job  performance. 

Contrary  to  the  assertion  of  Campbell  et  al.  (1993),  several  studies  have 
provided  evidence  for  a  general  factor  of  job  performance  (Carretta,  Perry, 
&  Ree,  1996:  Lance,  Teachout,  &  Donnelly,  1992;  Viswesvaran,  Schmidt,  & 
Ones,  2005).  DGFs  were  found  that  accounted  for  between  59%  and  92%, 
with  a  meta-analytic  finding  of  60%  (Viswesvaran  et  al.,  2005). 

Personality 

Personality  researchers  have  arrived  at  the  consensus  that  traits  can  be 
organized  reliably  into  five  broad  domains  called  the  Big  Five  (Costa  & 
McCrae,  1992).  These  are  Neuroticism,  Extraversion,  Openness,  Agreeable¬ 
ness,  and  Conscientiousness.  Recently,  several  studies  have  demonstrated 
the  existence  of  a  broad  general  factor  of  personality  that  accounts  for  be¬ 
tween  43%  and  50%  of  the  variance  in  Big  Five  measures  (Mathias,  2011; 
Musek,  2007;  Rushton  &  Irwing,  2008).  Just  (2011)  and  Rushton  and  Irwing 
(2011)  have  provided  reviews  of  the  literature  regarding  the  existence  of  a 
general  factor  of  personality  in  normal  personality.  A  general  factor  of  per¬ 
sonality  also  has  been  observed  in  psychopathology  (Caspi  et  al.,  2014). 

Additional  Examples 

Table  1  contains  results  of  studies  across  a  broad  range  of  constructs,  includ¬ 
ing  cognitive  ability,  emotional  intelligence,  personality,  psychomotor  per¬ 
formances,  beliefs  and  attitudes,  occupation  and  work,  and  leadership.  We 
examined  each  study  to  determine  the  extent  to  which  the  measures  used 
had  a  DGF.  The  DGF  values  in  the  table  range  from  38%  to  92%.  They  tend 
to  be  underestimates  because  most  studies  did  not  correct  for  unreliability 
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Table  1  Examples  of  Studies  Finding  a  Dominant  General  Factor 


Construct/measure 

Reference 

%  of  variance 
accounted  for 
by  DGF 

Air  Force  Officer  Qualifying  Test 

Cognitive  Ability 

Carretta  &  Ree  (1996) 

41 

Armed  Services  Vocational 

Ree  &  Carretta  (1994b) 

64 

Aptitude  Battery 

Cognitive  components  tests 

Stauffer  et  al.  (1996) 

48 

MicroCog 

Teachout,  Ree,  Barto,  King,  & 

52 

Multidimensional  Aptitude  Battery 

Carretta  (2014) 

Teachout  et  al.  (2014) 

48 

Emotional  Intelligence 

EQ-i 

644  USAF  Pararescue  jumpers 

70 

EQ-i-s 

in  advanced  training 

Parker,  Keefer,  &  Wood  (2011) 

54 

MSCEIT 

Fiori  &  Antonakis  (2011) 

52 

Big  Five 

Personality 

Mathias  (2011) 

43 

Big  Five 

Rushton  &  Irwing  (2008) 

45 

Big  Five  BFI,  IPIP,  BFO 

Musek  (2007) 

50,  40,  45 

Psychopathology 

Caspi  et  al.  (2014) 

71 

Basic  Attributes  Test  and  ASVAB 

Psychomotor 

Ree  &  Carretta  (1994a) 

39 

Basic  Attributes  Test 

Wheeler  &  Ree  (1997) 

42 

Suite  of  psychomotor  tests 

Ackerman  &  Cianciolo  (2000) 

51 

proposed  by  the  authors 

Experimental  psychomotor  (PM) 

Carretta  &  Ree  (1997) 

39 

tests  and  ASVAB — all  PM  scores 
and  ASVAB  technical  knowledge 
tests 

Beliefs  and  Attitudes 

Religion — spiritual  Well-Being 

Paloutzian  &  Ellison  (1991) 

38 

Scale 

Religion 

Mathias  (2011) 

46 

Occupation  and  Work 

Job  performance:  Situational 

Carretta  et  al.  (1996) 

92 

awareness  in  military  pilots 

Job  performance:  Military 

Lance,  Teachout,  &  Donnelly 

59 

electronics 

(1992) 

Job  performance:  Meta-analysis 

Viswesvaran,  Schmidt,  &  Ones 

60 

Organizational  conflict 

(2005) 

Rahim  &  Magner  (1995) 

45 
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Table  1  Continued 


Construct/measure 

Reference 

%  of  variance 
accounted  for 
by  DGF 

Entrepreneurship 

Ahmetoglu,  Leutner,  & 
Chamorro-Premuzic  (2011) 

67 

Job  satisfaction  JDI 

Edwards,  Bell,  Arthur,  &  Decuir 
(2008) 

57 

Organizational  citizenship 

Rahman,  Sulaiman,  Nasir,  & 
Omar  (2013) 

Leadership 

74 

Leadership  style  -  MLQ 

Avolio  &  Bass  (2004) 

73 

Leader  power:  Rahim  Leader 
Power  Inventory 

Ojo  (2008) 

62 

Servant  leadership 

Barbuto  &  Wheeler  (2006) 

67 

Servant  leadership 

van  Dierendonck  &  Nuijten 
(2011) 

56 

Motivation  to  lead 

Chan  &  Drasgow  (2001) 

59 

Leader-member  exchange 

Liden  &  Maslyn  (1998) 

Others 

61 

Assessment  centers 

Krause,  Kersting,  Heggestad,  & 
Thornton  (2006) 

65 

Core  self-evaluation 

Judge  et  al.  (2004) 

71 

Mentoring 

Castro,  Scandura,  &  Williams 
(2004) 

85 

Physical  ability 

Vickers,  Hogdon,  &  Beckett 
(2008) 

60 

Physical  ability 

644  USAF  Pararescue  jumpers 
in  advanced  training 

39 

Workload 

Hart  &  Staveland  (1988) 

61 

Note.  The  percentage  of  variance  accounted  for  by  the  dominant  factor  may  be  underestimated  be¬ 
cause  of  reliability  and  range  restriction  artifacts.  ASVAB  =  Armed  Services  Vocational  Aptitude 
Battery;  BFI  =  Big  Five  Inventory;  BFO  =  Big  Five  Observer;  DGF  =  domain  general  factor;  EQ-i  = 
Emotional  Quotient  Inventory;  EQ-i-s  =  Emotional  Quotient  Inventory  -  short  form;  IPIP  =  In¬ 
ternational  Personality  Item  Pool;  JDI  =  Job  Descriptive  Index;  MSCEIT  =  Mayer-Salovey-Caruso 
Emotional  Intelligence  Test;  MLQ  =  Multifactor  Leadership  Questionnaire;  USAF  =  United  States 
Air  Force. 


and  range  restriction.  It  should  be  noted  that  we  found  several  other  stud¬ 
ies  for  other  constructs  (e.g.,  political  attitudes)  in  the  literature,  in  which  a 
DGF  was  reported.  They  are  not  included  here  because  data  were  not  avail¬ 
able  to  allow  us  to  estimate  the  proportion  of  variance  accounted  for  by  the 
DGF. 
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Why  DGFs  Exist 

The  finding  of  general  factors  extends  to  almost  all  areas  of  measurement. 
Usually  the  developers  and  constructors  of  these  measures  seek  to  assess 
several  unique  or  independent  characteristics  but  instead  create  DGFs.  Fun¬ 
damental  and  overarching  questions  emerge:  Why,  when  we  want  to  measure 
several  different  factors,  do  we  wind  up  measuring  a  strong  general  factor 
with  much  weaker  specific  factors?  What  causes  the  DGFs,  and  why  are  they 
so  pervasive?  There  are  several  potential  answers  to  these  questions. 

Possible  Reasons  for  DGFs 

The  possible  reasons  for  DGFs  can  be  considered  to  fall  into  two  broad  cat¬ 
egories.  Some  are  methodological  or  statistical,  whereas  others  rely  on  psy¬ 
chological  theory.  We  present  examples  from  both  categories  and  recognize 
that  other  reasons  may  exist.  All  of  these  reasons  may  contribute  to  positive 
manifold. 

As  defined  earlier,  positive  manifold  means  that  all  of  the  variables  are 
positively  correlated.  It  can  be  argued  that  a  group  of  measures  in  a  battery 
does,  in  fact,  reflect  several  facets  of  performance  that  can  and  should  be 
distinguishable,  despite  the  fact  that  the  facets  are  intercorrelated.  However, 
positive  manifold  guarantees  a  general  factor,  although  not  always  a  domi¬ 
nant  one. 

Methodological  or  statistical  reasons  for  DGFs.  We  discuss  two  reasons 
that  may  contribute  to  the  observance  of  DGFs.  These  are  the  reliance  on 
coefficient  alpha  and  the  common  method  variance. 

Reliance  on  coefficient  alpha.  The  use  of  Cronbach’s  coefficient  alpha  con¬ 
tributes  to  the  production  of  DGFs.  Maximizing  coefficient  alpha  requires 
strong  correlations  among  items.  (Cortina,  1993;  Crocker  &  Algina,  1986; 
Cronbach,  1951;  Stanley,  1971).  If  we  rely  on  methods  of  estimating  reliabil¬ 
ity  that  place  an  emphasis  on  having  strong  correlations  among  items,  this 
will  increase  general  factor  strength  within  the  set  of  items  on  that  measure. 
Parallel  forms  (Stanley,  1971)  do  not  require  high  item  intercorrelations  and 
therefore  would  be  preferable  for  measures  expected  to  have  notable  contri¬ 
butions  from  specific  sources  of  variance. 

Coefficient  alpha  also  can  play  a  role  in  increasing  the  dominance  of  a 
DGF  in  multiple  aptitude  batteries.  For  example,  increasing  coefficient  alpha 
in  each  subtest  of  a  multiple  aptitude  battery  of  cognitive  tests  would  lead  to 
a  stronger  dominant  factor  (g )  for  the  entire  battery.  A  similar  result  is  likely 
for  measures  of  other  “multidimensional”  constructs. 

Common  method  variance.  The  most  accepted  definition  of  the  phe¬ 
nomenon  is  that  some  aspect  of  the  measurement  process  causes  the  cor¬ 
relations  or  causes  the  correlations  to  be  inflated  between  measures.  Less  of¬ 
ten  the  construct  of  common  method  variance  has  been  investigated  within 
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single  measures.  If  method  variance  exists,  it  must  exist  in  the  scores  of  the 
measure  even  when  the  measure  is  not  being  correlated  with  other  measures. 

Podsakoff,  MacKenzie,  Lee,  and  Podsakoff  (2003)  reviewed  common 
method  variance  models  and  offered  solutions  for  estimating  the  magnitude 
of  the  effects  and  either  eliminating  or  mitigating  them.  Recognizing  the  po¬ 
tential  for  common  method  variance  should  not  be  reason  for  discounting 
the  existence  of  DGFs. 

If  common  measurement  method  affects  one  source  of  variance  in  scores 
(tests,  questionnaires,  or  other  measures),  it  should  affect  all  sources.  That  is, 
each  source  of  variance  should  show  the  effects  of  measurement  method.  A 
study  investigating  the  effects  of  measurement  method  on  all  sources  of  score 
variance,  including  the  common  factors,  group  factors,  and  specific  factors 
should  be  performed.  Failure  to  find  measurement  method  variance  in  group 
or  specific  factors  casts  doubt  on  its  influence. 

Finally,  the  logical  fallacy  of  affirming  the  consequent  might  play  a  role. 
This  fallacy  can  be  explained  in  these  statements: 

1.  Common  method  variance  causes  DGFs. 

2.  A  DGF  is  found. 

3.  Therefore,  common  method  variance  must  be  the  cause. 

Statements  1  and  2  are  true  but  the  conclusion,  Statement  3,  is  not  nec¬ 
essarily  true.  The  conclusion  can  be  false  even  when  Statements  1  and  2  are 
true.  This  is  because  common  method  variance  was  not  asserted  to  be  the 
only  sufficient  condition  for  the  DGF.  There  may  be  other  causes  for  the 
DGF.  Only  a  properly  conducted  study  with  appropriate  statistical  methods 
and  corrections  of  artifacts  can  reveal  the  real  cause  or  causes. 

Psychological  theory  reasons  for  DGFs.  There  also  are  several  psycholog¬ 
ical  explanations  for  the  occurrence  of  DGFs.  These  include  the  halo  effect, 
the  impression  management  process,  the  theory  of  mutualism,  the  use  of 
cognitive  constructs  and  conceptual  structure,  and  the  construct  develop¬ 
ment  process. 

Halo  effect.  The  well-known  halo  effect  can  be  considered.  According  to 
this  effect,  the  evaluation  of  one  construct  influences  (covaries  with)  the  eval¬ 
uation  of  another.  This  has  been  evident  in  ratings  since  Thorndike  (1920). 
The  halo  effect  would  give  rise  to  a  DGF  as  the  covariances  among  the  eval¬ 
uations  become  nonzero.  Asch  (1946)  demonstrated  the  effect  of  one  per¬ 
sonality  trait  on  overall  ratings.  This  would  give  rise  to  the  halo  effect.  His 
work  was  clarified  by  Mensh  and  Wishner  (1947),  who  showed  that  context 
had  an  effect  on  ratings  and  thus  on  the  halo  effect.  Cooper  (1981)  noted 
that  the  magnitudes  of  the  intercategory  correlations  are  due  to  both  true 
intercorrelations  between  categories  and  illusory  theories  held  by  raters  re¬ 
garding  the  extent  to  which  categories  are  related  to  one  another.  Cooper 
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identified  several  cognitive  distortions  that  increase  the  perseverance  of  illu¬ 
sory  covariance  theories.  These  include  the  confirmatory  bias  in  hypothesis 
testing,  the  relative  ease  of  making  “same”  or  “similar”  judgments  as  opposed 
to  “different”  judgments,  the  tendency  to  discount  information  that  is  incon¬ 
sistent  with  existing  impressions,  and  the  failure  to  adequately  attend  to  hit 
rates. 

Impression  management.  Impression  management  is  the  process  by 
which  people  try  to  influence  the  perceptions  that  others  have  of  them. 
This  includes  social  settings  (Goffman,  1959)  and  the  workplace  (e.g., 
Giacalone  &  Rosenfeld,  1989;  Rosenfeld,  Giacalone,  &  Riordan,  2002).  Im¬ 
pression  management  may  contribute  to  DGFs  in  situations  in  which  sur¬ 
veys  or  subjective  measures  are  used.  For  example,  subordinates’  impression 
management  may  influence  performance  ratings  through  supervisors’  liking 
of  and  perceived  similarity  to  subordinates  (Wayne  &  Liden,  1995).  When 
impression  management  tactics  are  successful,  the  behavior  is  more  likely  to 
be  perceived  as  consistent.  Therefore,  the  relationships  among  dimensions 
of  behavior  are  greater  and  the  DGFs  are  more  likely. 

The  theory  of  mutualism.  A  reason  advanced  for  the  production  of  pos¬ 
itive  manifold  that  leads  to  DGFs  is  expressed  in  the  theory  of  mutualism 
(Raijmakers,  2006;  van  der  Maas  et  al„  2006).  According  to  the  theory  of 
mutualism,  specific  intellectual  abilities  exist  in  the  developing  human,  but 
with  growth  and  maturation,  the  use  of  these  specific  abilities  causes  them 
to  merge,  thereby  giving  rise  to  positive  manifold.  Positive  manifold  in  other 
human  characteristics  such  as  attitudes,  values,  personality,  psychomotor 
ability,  leadership,  or  job  performance  have  not  been  included  in  the  mutual¬ 
ism  theory.  The  theory  remains  untested  by  rigorous  methods,  and  the  truth 
or  falseness  of  the  theory  does  not  change  the  existence  of  positive  manifold 
in  people  from  childhood  to  adulthood. 

Cognitive  constructs  and  conceptual  structure.  Several  theories  have  been 
proposed  concerning  the  way  people  organize  ideas  and  concepts.  According 
to  prototype  theory  (Rosch,  1975)  and  exemplar  theory  (Nosofsky  &  Stan¬ 
ton,  2005),  people  make  judgments  to  place  new  ideas  and  objects  into  cat¬ 
egories  by  comparing  them  with  examples  already  stored  in  memory.  These 
theories  rely  on  the  same  general  cognitive  process  in  which  a  new  stimulus 
is  encountered,  a  concept  in  memory  is  triggered,  a  judgment  of  similarity 
occurs,  and  a  categorization  decision  made.  Prototype  theory  suggests  that 
a  new  stimulus  is  compared  with  a  single  prototype  in  a  category,  whereas 
exemplar  theory  suggests  that  the  new  stimulus  is  compared  with  several 
exemplars.  It  could  be  that  only  a  few  things  are  important  in  the  way  an 
individual  categorizes  new  ideas  and  objects  and  that  these  few  important 
concepts  associate  our  responses  to  concepts  related  to  them.  There  seems 
to  be  a  process  tying  apparently  separate  beliefs  together. 


Distribution  A:  Approved  for  public  release;  distribution  unlimited.  88ABW  Cleared  11/24/2014;  88ABW-201 5-5468. 


420  MALCOLM  JAMES  REE  ET  AL. 


Construct  development  process.  Why  do  we  often  observe  that  theoreti¬ 
cally  independent  dimensions  of  a  construct  are,  in  fact,  correlated?  In  the 
development  of  a  construct  such  as  job  satisfaction,  containing  several  di¬ 
mensions  in  which  each  dimension  is  related  to  the  construct,  we  should 
expect  these  dimensions  to  be  correlated.  We  often  overestimate  the  dis¬ 
tinctions  among  related  dimensions  and  constructs  and  underestimate  their 
overlap  or  relatedness.  This  presents  a  dilemma  because  we  intend  the  di¬ 
mensions  to  be  distinct  while  at  the  same  time  being  part  of  the  broader 
construct.  As  suggested  earlier,  the  results  of  the  data  analysis  should  de¬ 
termine  the  relative  extent  to  which  the  measures  are  consequences  of  the 
general  or  specific  sources  of  variance. 

Implications  of  Prevalence  of  DGFs 

Interpretation  of  factors.  An  important  implication  is  the  interpreta¬ 
tion  of  factors  and,  by  extension,  the  value  of  these  factors  for  theory 
and  practice.  Ree  and  Carretta  (1998)  noted  that  factors  are  frequently 
named  for  a  small  source  of  variance  and  interpreted  as  that  source  exclu¬ 
sively.  This  misinterprets  the  supporting  evidence  and  the  meaning  of  the 
measures. 

Validity.  Consider  a  situation  in  which  a  researcher  wants  to  test  the  the¬ 
ory  that  verbal  ability  adds  to  spatial  ability  in  the  prediction  of  job  perfor¬ 
mance.  Tests  called  Spatial  Reasoning  and  Verbal  Ability  were  administered 
to  an  appropriate  sample,  and  a  measure  of  job  performance  was  obtained  for 
that  sample.  Next,  two  regression  equations  were  estimated.  The  first  equa¬ 
tion  would  be  consistent  with  the  theory  that  specifies  that  spatial  ability  pre¬ 
dicts  job  performance,  and  the  second  equation  specifies  that  spatial  ability 
and  verbal  ability  predict  job  performance.  Finding  a  difference  in  the  pre¬ 
dictiveness  of  these  two  equations  could  lead  to  the  conclusion  that  verbal 
ability  incremented  spatial  ability  in  the  prediction  of  job  performance.  This, 
in  most  instances,  would  be  incorrect.  The  increment  in  validity  could  be  due 
to  the  added  reliable  variance  of  the  DGF,  which  contributes  to  both  spatial 
reasoning  and  verbal  ability  (Ree  &  Carretta,  201 1). 

Profiles.  The  interpretation  of  profiles  (a  combination  of  abilities  and 
other  characteristics)  is  made  more  difficult  by  the  presence  of  DGFs.  It  is 
most  problematic  in  a  sample  when  the  DGF  is  large  and  the  specific  sources 
of  variances  are  small  and  when  there  is  reduction  in  reliability  (Gulliksen, 
1950:  Eq.  5,  p.  124)  because  of  restriction  of  range. 

In  personality  profile  interpretation,  the  difference  between  scores  is 
usually  evaluated.  For  example,  a  high  value  in  a  particular  facet  of  person¬ 
ality  and  a  low  value  of  another  facet  may  be  consistent  with  a  specific  per¬ 
sonality  type.  Using  several  differing  regression  equations  to  predict  job  per¬ 
formance  in  job  families  is  similar.  Differences  in  profiles  and  differences  in 
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regression  equations  may  be  due  to  interpreting  the  differences  in  reliability 
and  variances  in  the  measurement  of  the  DGF  rather  than  the  measurement 
of  specific  characteristics. 

Risks  of  Ignoring  DGFs 

Ignoring  DGFs  poses  risks  and  potential  problems  for  both  theory  and  prac¬ 
tice.  For  theory,  ignoring  DGFs  may  place  an  overemphasis  on  the  magni¬ 
tude,  influence,  and  importance  of  the  specific  factors.  The  specific  factors 
make  a  relatively  small  contribution,  once  the  DGF  is  removed  as  a  source 
of  variance.  It  may  also  mislead  researchers  on  the  substance  and  meaning 
of  constructs  as  the  labels  for  specific  constructs  continue  to  be  used.  This 
leads  to  the  pursuit  of  more  research  evidence  to  support  the  existence  of 
specific  factors  and  their  role  as  either  predictors  or  criteria  in  organiza¬ 
tional  research  and  practice.  At  the  same  time,  an  underemphasis  or,  worse, 
the  omission  of  the  DGF  diminishes  its  value  and  misses  opportunities  for 
better  understanding  of  psychological  constructs.  Comparison  of  constructs 
that  are  mostly  the  same  DGF  (e.g.,  a  verbal  measure  versus  a  quantitative 
measure)  is  misleading  and  perpetuates  poor  procedures. 

In  practice,  analyses  that  fail  to  seek  DGFs  support  the  myth  of  the  im¬ 
portance  of  narrow  constructs  compared  with  more  general  constructs.  Be¬ 
cause  they  contain  more  reliable  variance  than  specific  factors,  DGFs  are 
likely  to  act  like  the  general  factor  in  cognitive  ability  and  have  greater  pre¬ 
dictiveness  than  specific  factors.  Valuable  resources  maybe  expended  trying 
to  develop  or  use  specific  measures  that  are  likely  to  be  less  predictive  than 
DGFs  are. 

Whereas  research  on  cognitive  ability  and  the  evidence  presented  here 
demonstrates  the  veracity  and  pervasiveness  of  the  DGF,  there  has  been  less 
deliberate  research  in  other  content  domains  that  illustrate  these  points.  One 
exception  over  the  last  decade  is  in  the  area  of  core  self-evaluations.  Judge, 
Erez,  Bono,  and  Thoresen  (2002,  2003)  developed  and  tested  the  validity  of 
a  12-item  measure  called  the  Core  Self-Evaluation  Scale,  which  is  based  on 
four  specific,  well-known  traits:  self-esteem,  generalized  self-efficacy,  locus 
of  control,  and  emotional  stability.  Results  indicated  a  reliable  single  factor, 
termed  a  core  factor,  with  validity  for  predicting  job  satisfaction,  job  perfor¬ 
mance,  and  life  satisfaction  equal  to  an  optimal  weighting  of  the  four  spe¬ 
cific  traits.  Further,  in  a  review  of  research  on  core  self-evaluations  (Judge, 
Van  Vienen,  &  De  Pater,  2004),  evidence  suggested  that  the  four  core  traits 
are  highly  related;  are  loaded  on  a  single  unitary  factor;  and,  it  is  important 
to  note,  “have  dubious  incremental  validity  controlling  for  their  common 
core”  (p.  325).  Essentially,  Judge  et  al.  (2002,  2003)  created  a  DGF  using 
four  reliable,  related  traits  about  “the  self.”  Although  we  have  provided  sub¬ 
stantial  evidence  on  the  existence,  prevalence,  and  importance  of  DGFs,  a 
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concerted  research  effort  is  needed  to  further  examine  the  implications  and 
consequences  of  DGFs  for  theory  building  and  practice. 

Conclusions 

DGFs  are  common  in  our  field  and  are  well  represented  by  the  first  unrotated 
principal  component.  As  discussed,  a  variety  of  methodological  and  statis¬ 
tical  factors  and  psychological  mechanisms  contribute  to  the  existence  and 
influence  of  DGFs.  Research  that  ignores  DGFs  by  treating  correlated  facets 
of  a  domain  as  if  they  were  distinct  and  uncorrelated  can  lead  to  a  number 
of  errors  and  misinterpretations. 

A  most  important  need  is  the  investigation  of  data  for  the  existence  of 
DGFs.  What  remains  after  a  DGF  has  been  estimated  is  the  specific  reli¬ 
able  variance  and  error.  If  this  analysis  is  not  conducted,  then  we  use  dif¬ 
ferent  labels  and  descriptions  for  each  of  the  dimensions.  This  leads  to  using 
each  dimension  as  a  predictor  or  criterion  in  various  aspects  of  research  and 
practice.  In  contrast,  a  large  DGF  and  small  specific  factor  for  each  of  the 
dimensions  potentially  changes  the  underlying  theory  and  meaning  of  the 
measures.  Any  construct  thought  to  be  multidimensional  should  be  inves¬ 
tigated  for  the  presence  and  magnitude  of  a  DGF.  Doing  so  would  facilitate 
understanding  of  the  construct  or  measurement  instrument. 

If  a  DGF  has  been  found,  it  is  important  to  determine  whether  the  DGF 
is  the  source  of  all  or  part  of  the  relationship  between  the  instrument  and  the 
dependent  variable.  In  both  bivariate  and  multiple  correlation/regression, 
the  reliable  variance  is  weighted  by  the  regression  coefficient.  The  weight 
is  based  on  the  relationship  or  partial  relationship  of  the  independent  vari¬ 
able^)  with  the  dependent  variable.  The  major  source  of  variance  in  the  in¬ 
dependent  and  dependent  variables  has  a  great  influence  on  the  sign  and 
magnitude  of  the  weight.  Often  the  prediction  is  wrongly  attributed  to  the 
specific  source  of  variance.  For  example,  when  a  test  of  verbal  ability  is  used 
to  predict  job  performance,  it  is  the  specific  verbal  source  of  variance  that 
is  frequently  given  credit  for  prediction.  However,  it  is  very  likely  that  the 
DGF  is  predictive  and  not  the  specific  verbal  factor  (Jensen,  1998;  Ree  & 
Earles,  1991a,  1992;  Ree  et  al.,  1994).  Studies  to  determine  the  predictiveness 
of  DGFs  compared  with  specific  factors  should  be  conducted  across  a  wide 
variety  of  constructs  and  content  areas. 

Efforts  to  develop  multidimensional  measures  require  that  the  causes  of 
DGFs  be  determined  so  that  developers  can  act  on  these  causes,  to  either 
increase  or  decrease  their  influence.  This  requires  a  concerted  effort  to  eval¬ 
uate  the  reasons  for  DGFs  from  among  those  offered  or  those  that  are  due  to 
other  causes. 

Further,  we  must  temper  our  understanding  of  the  nature  of  multidi¬ 
mensionality  to  reflect  DGFs.  If  we  name  factors  taking  into  account  only 
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the  specific  variance,  we  sow  the  seeds  of  confusion  and  misunderstanding. 
To  advance  the  scientific  understanding  of  constructs,  we  should  strive  for 
clarity  of  the  sources  of  variance  and  clarity  of  meaning. 

Finally,  developers  of  tests  and  other  measurement  instruments  ought 
to  recognize  the  sources  of  variance  for  the  constructs  measured  by  the  in¬ 
strument.  Inferences  and  claims  about  what  is  being  measured  should  be 
consistent  with  the  sources  of  variance.  These  inferences  and  claims  should 
be  presented  proportionally  to  the  magnitude  of  the  sources  of  variance. 
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